SD 205 966 

XOTHOF 
TITLE 

POB DATE 
HOTE 



EDFs pfic;b 

DESCRIPTORS 



CS 206 538 



Teal, Faaon: HulM'e, Sale 

Assessing the ffriting SIcill of Pcospective English 

Teachers, ^ 

91 

8p.: Paper presented at the Annual Meeting of the 
International Feading Association C26th, Hew Orleans, 
LA, April 27-Hay 1, 1981) . 
* 

MPOI/PCOI "Plus p'ostage, 

*Co*aunication , Skills: Higher Education; *8easureient 
Techniques: 'Heasures (IniLviduals) ; Predictive 
Mbasarenent: Presefvice Teacher Edacatioa; *Student 
Teacher.s: 'Teaching Skills: writing Instruction; 
♦writing Skills 



ABSTRAC' ' 

The basi^ coiaLupication skills of prospective 
teachers at the University of Georgia wene issessai with Jtaowledge 
aid perforiance instraacnts. The knowledge instraaent was \ critecioa 
referenced test ijj comaunica'tiTe arts /logical re'asoning, library 
research, coaposition, langaage, coaaunications aeiia and careers, 
literature,* reading, .and oral coaaunicationl . The perforaanc^e 
aeasares included teaching plans and aaterial?., classroom procedures, 
and interpersonal skills. Other data, such as ,the Hational Teacher 
Exaaifeation (NTS) scores and ratings by cooperatiag teachers or 
university supervisors, were also collected. The lata show the 
aeneral estimates of the interns' ability to write bat not of their 
, abilitv to teach writing, These'correlations also show that coaaonly 
used oblective aeasures like the NTE or criterion referenced tests 
fallow tne same, pattern. In coaparinq these results with assessaent 
results froa twb other states, four conclusions can be drairn; O) 
teacher candidates are being checked .for basic skills, (2t the 
priaarv aode for checking their writing is* a dir^t aeasar? of 
writing, (3» most English teacher candidates pass these writing 
testai, and (U) assessaents of the writing skill of prospective 
teachers aiaht identify their writing ability, but -not their ability 
to teach writing.' (HOD) 
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THE EDUCATIONAL RE^URfcES Pom^r, ^1 o ^ / A i ^ it i 

^FORMATION CENTER (ERIC) i ^ ^^^ ^'^1^ Hulme 

Our Interest In the bcjslc communication skills of prospective teachers 
stems fromoar xnvoKfement m the development and u^e of two assest>miHiy 
instruments m Georgia. One come^ from a set of kncwle^^t instruments U)<iL 
i;icludes more than twenty. toAhiag fields. It\is a critt^rion rc'feron.cd Le^^ 

4 

in Communicative Arts (CRT-CA) coverin^^ eight areas: logical rea.cMuri^:, 

, library research, composition, language, communications mediar and careers, 

litetature, reading, and oral coTimunications Passing this te^t is r^-quired 

for^first time certification English. 

The second Georgia assessment instrument is actually a collection uf 

%iree performance Instruments Teaching Plans and Materials, Classroon 

Proceijures, and l4nit.erpersonal SklHs. The instruments are, in fact, rating 

forms for forty-five teaching behaviors (indicators; grouped under •fourt.'^en 

teacfie'r competencies such as "uses a variety of teaching methods" and 

* % 

i 

''manages classroom interactions." Together' thev are called the Teacher • 
Performance Assessment Instruments (TPAI). i 

i 

Both the knowledge and thi? performance instruments ^.cre u^ed with U(A 

V 

English interns for the 1979-80 school vear. We also collected other data 
such as National Teacher Examinations (NTE)? scores and teacher or' un i ver^i tv 



V 



supervisor ratings. From all these data .sources, we'v?^ LollecteJ 

i 



all scores that relate to UGA prospective English teachers' knowledp.e^of 
composition as well as to their^ skill in writing.^* Relationships among these 
data are summarized below. They aje then compared -wlt^'i other assessment 
results from Pennsylvania and South Carolina. ' ' 

In* selecting data from the study described above, we chbse to use as 
criterion measures two supervisor ratings-;-one of the prospective teachers' 



*Unless otherwise noted, all background Information In this repu^^t cum^s frt'm 
this UGA*'source. 



intormation in this report 
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wrlting^sklll and one of the^ ability to teach writing. We made this thoin 
principally because. In thf^yj^l^^joubly cited stad\, suptrvisor rami,-;, cOi- 
related F.orc than any uther pVediLtur with successful tcuhiav r i '\in> as 
Indicated by the: T^AI.^ 

The correlations reported in Table 1 ar6 between four measures related 
t6 writing and the two criteria (supervisor ratings) alreadv mentioned, Ihe^ 
first writing measur-e, the NTE English Expres^sion test, is onlv uru part nf 
the general or common examination. It i^ a multiple choice ti>st af Vn^lish 
\jsage and^ ef l^^^veness* of expression. The .51 correlation indicait-. at Ka-,t 
a moderate association betweeil this ejubtest of the NTE and the universU\ 
superivsors' estimate of the interns' writing skill. The'. 32 corrtlatibn fur 
the same NTE subtest and the supervisors' estimate of the interns' abilit 
teach writing implies a positive but not strong association for the ^twn 
variables. If tke judgment of the .university supervisor (field ctnter direct^^rj 
is taicen as a criterion for the prospective English teachers' writin^; ah^lit, 
or ability to teach writing, then the "English Expression" score from the 
NTE is a r.elativel? weak predictor and certannlv not a substitute for the 
supervisor's judgment* ^ 

Much of the same story applies to the second variable listed in Table 1, 
the NTB "English" option or area test score. Correlations of .51 ahd ,40 
parallel Phe .31 and .32 for the NTE English expression score— a minor nredic- 
tlon but no substitute. ^ 

According to the Gec^rgia Department of Education (DOE) the "composition" ^ 
section of the Georgia CRT in communicative arts is only a test of knowledge 
about composition and the teaching of composition, not an estimate of the ablXttj/ 
to teach writing. In a sense, then, the correlations in Table 1 confirm this 
DOE Contention. The coef f iciej^ts, .38 J^etween the'CRT composition section and 
the supervisor's rating of writing abil^'ity and .09 between the CR\conposlt Ion 
section and the supervisor's rating of the ability to teach writing, Suggest 
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TABLE 3 

use Scr <>enl n j Tes t Result s 

Can dida t O S Tas< Fail )>.isb> F^il 

Nurnber 329 ,236 ^3 ' 67 aj^ 

(Percentage) (72) (28) (72) (2B) 



*Slgnlflcant, at least, at tht* 05 level. 



a distinct difference between the two abilities, further, the predictive 
power of the composition section parallels that of the entire CRT, with at 
l^east moderate associations existing between it ^nd other knowledge test^ 
like the NTE (or grades) but virtua/ly none between it and the e^fuLtivc 
teaching behikviors identified by the TPAI. • |. 

^ Each^of the three Objective tests identified so far are limUtd in their » 
ability to predict supervisors' ratings of writing ability and t*. aching- aL i U t 
The two parts of the NTE show rainimun associations, •32^and .40, and the (.eor^ia 
CRT composition score shows essentially no correlation at all (-09). rhe 



predictive 
writing- 



fourth rr^^^asure cheLked.Tlie supervisor's overall rating, offers the stroni^^tst 
predictiye power, .63 with writm-g ability and .^^9 with the abilitv to teach 

Perhaps this association results frori some sort of "halo" tffcct; 
that IS the supervisor's general estimate of the intern's abilities influx, net 
his/her estimate of particular abilities like writing or the teachiri^ of 
writing. On the other nand, the influence may be in the reverse direction, 
from writing abilities to general abilities • ^ ^ 

i 

If, then, \he correlated supervisors' ratings are all suspect and the 

objective measures are weak in prediction, what about another possibilitv, r^ttd 

writing samples. This past fall, a relatively small population (10 interns) was 

asked to provide one descriptive paper, a short assignment to compare two; 

schools visited for observations, ^s a sample of thelV ability to write. We then 

compared* nJodif led analytic aad primary trait ratings (two raters acliieved 90^' 

agreement within one score point) with supervisors' ratings of writing ability 

and the ability to teach writing. We also checked the level of correlation 

\ 

between the interns' scores on the CRT tomoositig^ test and C^eir ratings bv 
supervisors. The correlations listed in Table 2 Reveal the results of these 
comparisons. / ' 

Both of the writing sample ratings, analytic and primary trait, are firig- 
nif leant ly correlated (.76 and .82; with supervisors' ratings of the interns' 



' ability to write and their Nabilitv to teach writing Also, sup^Tvisors 

ratings of general ability >0 <each are similarlv correlated at 83 On the ^ 

other hand, these bane predictors ^(rated writing baraples and ratinK- ^^ent^ral 

teaching ability) do not si^^nif leantly correlate with[est imates tsf the* ahilitr 

to teach writing. Nor, for this small sanple^ do CRT composition bCor».s Lorrd itt 

with estimates of the abilities to write or to teach writing. 

^ ^ . . . i 

In summary^ general estimates of teaching abxlltv and rated writing .aropU 

converge to predict (.63, .76, and .82) supervisors' estimates of the intern-.' 

ability to write but not of theii ability to teach writing. In sliort, 'aptr- 

visors can.n>ore easllv identif; pood writers than the^ ^ an '.1:^'^'^^^ ^ ' 'i ^ * 

of writf^n^. The^e turrclation- ai-^ s ^ , at 1l iM f' r ^^<t^:^t, tf . ' - v] 

used nb "er. t ive ^( I'.urcs lake tii- tr th** ''^ T fnlh^. tU ,'tt»^n, -mi.. 

measures pick )ut 'ood writers lt„Lt*r tiirin th* v identify' aac^d te^uiurs < f wrirn. 
» • ( 

As part ofats de/.:lnptng program m sccnndarv educaiion m 1^8')% iV^nn 
State used a modified holistic ratint: sv^f^m to assess the uritiut; si- i ] I pf all 
Its prospective teachers in/^fivt T>ubj^ct areas Ln^^ish, rrathLinaLJ.Li ^ "-Lurui , 
4 social studies, and forei?;n lan^ns^gi^^f^^Englishy science, and forei.^n 1 mgiuice 

f ' / • ' ^ 

teacher. candidates .scored equally ^ell and a little hi^;her t)ian tht social 

2 

studies and mathematics teachers % As yet, no pass-fail rate^ have be^.n re- 

ported, but results confirm that not all prospective teachers are --^like in 

their writing abilifv. 

Much the same st;ory is reported for the I'nlversitv of Pittsbur^;h, c<cepL 

that the English teacher candidates scored slightly hi^h^r than all the others , 

3 

on the College English Placement Test . 

A 1979 teacher education and certification law in South Carolina requires 
tralni'fig institutions to screen teacher education applicants in the basic skill 
areas of reading, mathematics, and wx:itlng- Uurlng^the 1978-79 year, the Tni- 
vef^lty of ^ South Carolina (USt) initiated screeninr> teats and remedial' in.strui - 
tion in t^ese three area-. Hie numbers in Table 3 reveal the experience rsc 



had* Initially, iT/. passed; then, wxth remediation, ll\ of tiie first f^iilurts 
passed on t^e* second -or third trials. Therefore, m the end 92% passed. The? ^ 
criterion USC used* was the mean of seventeen ^^ear-olds In the «>amp-Je gf t he 
National Assessnent of Educational l'rugre$s,^ 

The writing test, coioposed gf several different assignments. Included a 
persuasWe, an explanatory, and a desc*rlptlve tasl- . The wrlttem pa[>ers, U t- 
ters, etc. were rated hoi ist ically , analytically, and according to prjLh<irv 

♦ • 

traits. Of the 28,^ t/ho did not meet the^ mean seventeen vear*old cutoff scores 

I 

18% came in the area of writl'ng, Qj\ly 22 failed to make,5fche cutoff score ;n 
reading. 

For those who did fall, counseling and remedial assistance were available 
in the College of Education and, for writing, there ^as *also a writing l^Jbora- 
tory in the University English department. The remediat ion nrogran iias h<<\\ * 
relatively succe^ssful, particularly for helping minoriry candidates overcome 
the difficulties §oiaetimes encountered witi^ objective, standardized 'tests* 
In the original* testing about two-thirds of the white students and cme-tlurd 
of the bl%ck students passed; and then, on the retest, 74a of the white s-t-udent 
passed and 55%^of the black students passed^ 

I Several conclusions that can be drawn from the experience of t'lcse four 
state universities ai;e, first, that' teacher candidates are certainlv beiftg 
checked for basic skills and, second, that th^ primary mode for ctleckiag on 
writing is a direct 'Measure of writing. A third conclusion Is that roost, but 
not all, English teacher candidates ^pass these writing tests. And, fin^ilK, 
assessments of the writing skill of , prospective teachers might identifs tUeii 
writing ability but not their ability to teach writing. 
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